DYNAMICS OF LINEAR MAPS OF IDEMPOTENT MEASURES 



U.A. ROZIKOV, M.M. KARIMOV 

Abstract. We describe all linear operators which maps n — 1-dimensional simplex of 
idempotent measures to itself. Such operators divided to two classes: the first class 
contains all n x n-matrices with non-negative entries which has at least one zero-row; 
the second class contains all n x n-matrices with non-negative entries which in each row 
and in each column has exactly one non-zero entry. These matrices play a role of the 
stochastic matrices in case of idempotent measures. For both classes of linear maps we 
find fixed points. We also study the dynamical systems generated by the linear maps 
of the set of idempotent measures. 
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1. Introduction 

In the most general sense, a dynamical system is a tuple (T, M, where T is a monoid, 
written additively, M is a set and <3? is a function «J> : U C T x M — > M with 

I(x) ={t£T:(t,x)e U}, $(0,a?) = x, 

$(t 2 ,®(ti,x)) = ^(t 1 + t 2 ,x), foTti,t 2 ,t 1 + t 2 E I(x). 

The function x) is called the evolution function of the dynamical system: it as- 
sociates to every point in the set M a unique image, depending on the variable t, called 
the evolution parameter. M is called phase space or state space, while the variable x is 
called initial state of the system. 

Varying parameters T, M, $ one can define different kind of dynamical systems, for 
example, it is known the following cases: 

Real dynamical system: A real dynamical system, real-time dynamical system or flow 
is a tuple (T, M, <£) with T an open interval in the real numbers R, M a manifold locally 
diffeomorphic to a Banach space, and $ a continuous function. 

Cellular automaton: A cellular automaton is a tuple (T, M, with T the integers, 
M a finite set, and $ an evolution function. 

Discrete dynamical system: A discrete dynamical system, discrete-time dynamical 
system, map or cascade is a tuple (T, M, <£) with T the integers, M a manifold locally 
diffeomorphic to a Banach space, and $ a function. 

If M = S 171 ' 1 = {x = . . . , x m ) G R m : Xi > 0, YT=i x i = l}-simplex of probability 
measures on the set E = {1, 2, . . . , m} and $ is a stochastic matrix, then the dynamical 
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system describes a Markov chain [llj. Moreover if M = S m ~ l and $ is a quadratic 
stochastic operator [6] then the dynamical system describes evolution of a population. 

In idempotent mathematics the usual arithmetic operations are replaced with a new 
set of basic associative operations (a new addition © and a new multiplication 0) so that 
all the semifield or semiring axioms hold; moreover, the new addition is idempotent, i.e., 
x © x = x for every element x of the corresponding semiring, see, e.g., [Hl3lHllTH9irT2] ■ 

A typical example is the semifield R m ax = RU {— oo} known as the Max-Plus algebra. 
This semifield consists of all real numbers and an additional element = — oo. This 
element is the zero element in R max; and the basic operations are defined by the 
formulas x © y = max{x, y} and x y = x + y; the identity (or unit) element 1 coincides 
with the usual zero 0. 

In this paper, we consider M as the simplex I n of idempotent measures on {1, 2, . . . , n}, 
where 

%n, = {(^lj ■■■i x n) £ R-max ' m & x x i = 0} = {(^1, X n ) £ R-max : x l © •■• © x n = 1} 

l<i<n 

and consider linear maps of I n to itself. The term idempotent measure in our case is 
used in the sense of idempotent analysis ( [HF7 ti9l[T2] ) rather than in the sense of abstract 
harmonic analysis as in |10| . 

Idempotent measure theory has recently emerged as a new branch of mathematics 
analysis for studying deterministic control problems and first-order nonlinear partial dif- 
ferential equations such as Hamilton-Jacobi equations with discontinuous initial data 
and low-lying eigenfunctions of Schrddinger operator. During the past 20 years its appli- 
cations have grown, establishing unexpected connections with a number of other fields. 

The linear dynamical systems of idempotent measures which we shall consider in this 
paper are "idempotent" analogies of Markov chains, in our case a state of the Markov 
chain is an idempotent measure, but linearity of the evolution operator is defined by 
the usual operations + and •. In [HE] an idempotent analogue of the Markov chain is 
introduced in their case the linearity of the evolution operator is defined by the new 
operations © and 0. Thus investigations of our paper has more relations with usual 
analysis than idempotent one. 

The paper is organized as follows. In Section 2 we describe all linear operators which 
maps n — 1-dimensional simplex of idempotent measures to itself. Such operators divided 
to two classes: the first class contains all n x n-matrices with non-negative entries which 
has at least one zero-row; the second class contains all n x n-matrices with non-negative 
entries which in each row and in each column has exactly one non-zero entry. These 
matrices play a role of the stochastic matrices in case of idempotent measures. Hence 
they can be called idempotent-stochastic matrices. Section 3 contains a description of 
fixed points for both classes of linear maps. The last Section is devoted to the dynamical 
systems generated by the linear maps of the set of idempotent measures. 

2. Linear maps of X n to itself 

It is known (see, e.g., that the properties of homogeneous Markov chains with 
the phase space E = {1, . . . , m} can by completely determined by the initial distribution 
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x £ S m and a stochastic matrix P, i.e., P maps S m to itself iff P is a stochastic 
matrix. The theory of dynamical systems (Markov chains) generated by P is known (see 
for example 

In this section we shall answer the question: which linear map maps X n to itself? The 
following theorem describes such linear maps. 

Theorem 2.1. A linear operator A = (aij)i j=i ..., n maps X n to itself, if and only if it 
satisfies one of the following conditions: 

(i) aij > and A has at least one zero-row; 

(h) ciij > and each row and each column of A contains exactly one non-zero ele- 
ment. 

Proof. Sufficiency. 1. Assume the condition (i) is satisfied. For any x £ T n we shall 
show that y = A{x) £ X n . If ith row of A is zero row then yi = 0. Since atj > and 
Xj < we get 

n 

yk = a kjXj < 0, for all k ^ i. 

3=1 

Hence y = A(x) £ Z n , for any x £ X n . 

2. Assume now that the condition (ii) is satisfied. Then there are ii,*2>— >*n £ 
{1, ...,n} such that a^j. > and = if 7^ ij. In this case the operator y = A(x) 
has the following form 

By Xj < and > we get y« < for all i = l,...,n. Since at least one 
of coordinates xj is equal to zero, at least one of yi = aijXj is equal to zero. Hence 
y = A(x) £ l n . 

Necessariness. Assume both conditions (i) and (ii) are not satisfied. The following 
three cases are possible: 

a) All rows of A are non-zero and at least one row contains more than one non-zero 
element. Without lost of the generality we divide rows of A in two class: in each row 
aW = [an, din), i = l,...,ni there exists exactly one non-zero element a^.; in each 
row a'*', i = n\ + 1, n there are at least two non-zero elements. Then operator A has 
the following form 

Vi = aikiXkn 
y 2 = a 2 k 2 Xk 2 , 

y-ni = a n 1 k ni Xk ni - l 
Vni+1 = J2j a ni+ljXj, 

= Xyj Q"njXj- 

Take jo £ {n% + 1, n} and choose x = (x±, x n ) such that Xj = 0, Xj 7^ 0, j ^ jo. 
Then 7^ 0, i = l,...,n\ and since in each yi,i = n\ + l,...,n there are at least two 



4 



U.A. ROZIKOV, M.M. KARIMOV 



non-zero coefficient a^, we get yi ^ 0, for any i = n\ + 1, ...,n. Hence the condition 
maxjyi, y n } = is not satisfied and y = A (a;) £T n . 

b) All rows of A are non-zero and at least one column contains more than one non-zero 
element, but each row has exactly one non-zero element. Then such a matrix contains 
at least one zero-column. Without lost of generality we assume that the last column is 
zero. Then coordinate x n of x does not give any contribution to A(x). If we take x such 
that x n = and X{ < for all i ^ n then yi ^ for any i = 1, . . . , n so y = A{x) ^ I n . 

c) Assume one of is negative, let < 0. We choose x £ I n such that x^ / 
and = for all j / hi. Then a^x^ > 0, i.e. i-th coordinate of y is positive. Hence 
y i In. □ 

The following proposition gives characteristic of the operator satisfying condition (ii). 
Let s n be the group of permutations of 1, 2, . . . , n. 

Proposition 2.2. (a) For any matrix A satisfying condition (ii) there exists ir = 
tt(A) £ s n such that 



( a n ... ai n \ 

0-21 • • • 0,2n 



A — A w 



a i7T (i) > 0, 1 < i < n 
and the rest of elements aij = 



y flnl • • • Q-nra y 

(b) For any 7r, t (E s n the following equality holds 

A A -- A 

The set G = {A n : ir G s n } is a multiplicative group. 

Proof, (a) Since each row and each column of the matrix A must contain exactly one 
non-zero element, there are distinct numbers i\,i2, ■■■,i n £ {!>•••) n } such that a^j. > 
and a,jk = if k ^ ij. It is not difficult to see that every such matrix A corresponds to 
the permutation ir = (ir(j), j = 1, . . . , n), with ir{j) = ij. This permutation is unique. 
Thus if given A with condition (ii) then we can construct ir = ir(A), conversely, if given 
a permutation ir we can define matrix A n by = 0, if j ^ and > 0, if j = ir(i). 
(b) Take A w = {aij} and A T = {hij}. Let A w ■ A T = {Qj}. It is easy to see that 



Cij 



if j ^ r(7r(i)); 

k ai7r(i)^7r(j)T(7r(i)) if 3 = T ( 7r W)- 

This gives J 4 7r A T = A T7r and then one easily can check that G is a group. □ 

3. Fixed points of A. 

Recall that fixed points of A : l n — > Z n are solutions to A(x) = x. Denote by Fix(A) 
the set of all fixed points of A. 
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Case (i): Let A satisfies condition (i) of Theorem l2.1i Then without lost of generality 
we assume that there is no £ {1, . . . , n} such that all rows j = no + 1, . . . , n are 
zero-rows. For such a linear operator A the following lemma is obvious: 

Lemma 3.1. 1. The set Tn,no 

= {x € l n ■ Xj = 0, j = n + 1, n} is invariant 
with respect to A, i.e. A(I n ^ nQ ) C I n ,n - Moreover A(x) £ I n ,n for any x € I n - 
2. The set of fixed points Fix(^4) is a subset ofl n ^ no . 



By this lemma the equation A(x) = x has Xj 
reduced to the form A no (x) = 0, where x = (xi, 

( an - 1 ai2 
a 2 i a 2 2 - 1 



for all j = no + 1, . . . , n and can be 
. ,x no ) and 



.4 



"0 



V 



Onol 



O no 2 



O2n 



1 



If det(^4o) 7^ then the equation A nQ (x) = has unique solution x = (0, ...,0). If 
det(A no ) = and rank( J 4 rao ) = r then we can assume that the first r rows of A no are 
linearly independent, consequently, the equation can be written as 



»0 



Xi 



^! d-ijXj, i 

j=r+l 



I.. 



(3.1) 



where d. 



Mdiil W i t h 



« ~~ det(A r ) 



Aij 



( a u - I 

0,21 



&2,i-l &2j G2,i+1 



air 

a 2r 



\ O r \ 



_i a 



1 



/ 



An interesting problem is to find a necessary and sufficient condition on matrix D = 
(dij) i=i,...,r under which the system (|3.ip has unique solution (remember that we are 

j=r+l,...,no 

looking for solutions with Xi < 0). The difficulty of the problem depends on rank r, here 
we shall consider the case r = no — 1. 

Proposition 3.2. (cf. with Proposition of f^) 

1) 7/det(^4 no ) 7^ then the operator A has unique fixed point (0, ...,0) G Z n . 

2) 7/det(^4 no ) = and rank(A no ) = no — 1 then operator A has unique fixed point 
(0, 0) if and only if 



det(ylj ori Q , 
for some zq G {1, . . . , no — 1}. 



det(A 



>0, 



(3.2) 
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3) If the condition \3. 2fy is not satisfied then operator A has infinitely many fixed 
points x = x(a) of the form 



x(a) 



det(Ai no )_ det(A 2no ) 



det(A 



n -ln 



det(A no _i 
where a < 0. 



det(A. 



no— 1/ 



det(A 



no— lj 



a, a, 0, 0, . . . , 



Proof. 1) Straightforward. 

2) If rank(A no ) = n — 1 then from (|3.ip we get 

det(A ino ) 

X ' == 

det(A no _i) 

From (|3.3|) it follows that the condition 
solution (0, . . . , 0). 

3) Follows from ()3.3p taking a = x no . 



,n 



1. 



(3.3) 



is necessary and sufficient to have unique 

□ 

Now we shall give full description of fixed points of A for n = 3 and no = 2. 
Proposition 3.3. If n = 3 and uq = 2 then Fix(A) has the following form 



Fix(A) 
where c 



{(ca, a,0),a < 0}, if det(A2) = 0, an < 1; 

{(a,/3,0), a < 0, (3 < 0}, if ai 2 = a 2 \ = 0, an = a 22 = 1; 

{(0,0,0)} otherwise 



a 12 



l-on 



Proof. The proof consists a detailed analysis of equation ^(x) = x. 



□ 



Case (ii): Assume A satisfies the condition (ii) of Theorem 12.11 In this case by 
Proposition 12.21 A is represented as A n . 
Let us first consider an example: 
Example 1. Consider matrix 



A 



( 


Q 








o \ 


p 


























7 











6 





1° 





V 





V 



a^bn > 0. 



Corresponding it is 7r = (12) (35) (4) and equation A(x) = x has the following form: 

x\ = ax 2 , x 2 = /3xi, x 3 = jx 5 , x A = 5x 4 , x 5 = nx 3 . (3.4) 
From system (|3.4p we get 

x\ = a/3xx, x 3 = 77723, X4 = 0x4. (3-5) 
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Fix(A) 



Consequently we have 

{(0,0,0,0,0)}, if a/3^1, 7777^1, 5^1; 
{(xi,pxi, 0,0,0), X! < 0}, if ap = 1,^^1,8? 1; 
{(0, 0, s 3 , 0, V x 3 ), x 3 < 0}, if a/3 7^ 1, 777 = 1, 5 7^ 1; 
{(0,0,0,x 4 ,0), x 4 < 0}, if 0/3^1,77/^1,5=1; 
{(xi,/3xi,x 3 , 0,77x3), xi < 0,x 3 < 0}, if a/3 = 1, 777 = 1, 8 7^ 1; 
{(xi, /3xi, 0, X4, 0), xi < 0, X4 < 0}, if a/3 = 1, 777 7^ 1, 5 = 1; 
{(0,0,x 3 ,X4,7/x 3 ), x 3 < 0,x 4 < 0}, if a/3 / 1, 777 = 1, 5 = 1; 
{(xi, /3xi, x 3 , X4, 7/x 3 ), xi < 0, x 3 < 0, X4 < 0, xix 3 X4 = 0}, if a/3 = 777 = 5 = 1. 

The following theorem generalizes Example 1 for arbitrary j4 satisfying condition (ii). 
Theorem 3.4. If permutation ir has the following decomposition into disjoint cycles 



7T 



(ill, 712, .■•,*lfei)(i21,*22, ■■■,i2k 2 )---(iqi, i q2' ■■■, i qk q ), 1 < Q < n, 1 < kj < H, 



then 



1 ^ I, for all j = 1, . . . ,q then the fixed point (0, 0, 0) of 



(1) Ifa^i 
A n is unique. 

(2) If there are ji, j p , with some p € {l,...,q} such that ai Jsl i Js2 - 
1, s = 1, . . . ,p then there are infinitely many fixed points with p free coordinates 
if p < q and with q—1 free coordinates if p = q. 



Proof. The equation Ax = x has the following form 

X ij 3 = a ij s ijs+l X ijs+l S = 1, . . . ,kj, 

From (|3.6p we get 



l,...,q. 



If %iij2 a ij2ij3— a ijk j ij 



the proof. 



(3-6) 

(3.7) 
and if 

1 then it has infinitely many solutions X{. x < 0. This completes 

□ 



x ijl • 



1 ^ 1 then equation (13.7j) has unique solution Xi n 



4. Behavior of trajectories 

Let x(°) G X n be an initial point, and let {x^°\ x^\ x^, . . . } be the trajectory (dy- 
namical system) of the point x^ with respect to operator A, i.e. x^ m+1 -* = A(x^), m = 
0,1,.... Denote by uj(x^) the set of limit points of the trajectory x^ m \m > 0. Since 
{x( m )}^ =0 C l n and l n is a compact set [12], it follows that + 0. If oj{x^) 

consists of a single point, then the trajectory converges, and the point is a fixed point of 
the operator A. 

Let us first investigate the trajectory x^ m \m > when the initial point x^ ) contains 
a coordinate equal to — oo. For given operator A satisfying (i) or (ii) we define a directed 
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pseudograph (or multigraph i.e. a "graph" which can have both multiple edges and 
loops), Ga = (V, L) with vertices V = {1, 2, . . . , n} and edges L as 

L = '■ with direction from i to j if ajj > 0}. 

Note that this graph contains a loop (i, i) if an > 0, the graph contains two edges 
connecting i and j if aijaji > 0. In the last case one edge directed from i to j, another 
one is directed from j to i. 

Proposition 4.1. a) // has not any coordinate equal to —oo then does 
not contain any coordinate equal to — oo for any finite m > 1. 

b) If graph Ga does not contain any cycle (taking directions into account) and 
has some coordinates equal to — oo then the vectors x^ m \ m > n do not contain 
any coordinate equal to —oo. 

c) If the collection of vertices . . . ,i q } C V, q > 1 gives a cycle on the graph 

Ga and if xf* = — oo for some k = l,...,q then the vectors x^ have at 
least one coordinate equal to — oo for any m > 1. Moreover, the vectors Uj = 
(uj s i, . . . , Uj tn ) G X n , with Uj t i = if i ^ ij and Ujj = — oo if i = ij, j = 1, . . . ,q 
form a q-cycle with respect to the operator A. 

Proof, a) Straightforward. 

b) Since the graph does not contain any cycle, it only contains (directed) paths. 
Assume the longest directed path of the graph Ga is p = Pi,P2, ■ ■ ■ ,Pk = Qi k < n, from 
p£V to q£V,p^q and suppose x^ = — oo then since a P2pi > we have x p l 2 = — oo. 
Similarly we get x p \ ^ = — oo for i = 3, . . . , k. Since aj Pk = for any j = 1, . . . , n 
(otherwise the path is not the longest) the last — oo does not give any contribution to 

This argument also works for any shorter path, i.e. after finite steps (the length of 
the path) a " — oo" coordinate does not give any contribution to the next terms of the 
trajectory. Since the length of the longest path can not be larger than n, starting from 
step n all " — oo" coordinates disappear from x^ m \ m > n. 

c) Without lost of generality we assume that ij = j for all j = 1, . . . , q and assume that 

xf 1 ^ = — oo. Then it is easy to see that x% = — oo, x^ = — oo,. . . . Since the collection 
of vertices {1, ... ,q\ is a cycle, the — oo coordinate "travels" cyclicly as follows: 

a>) _> x[* s+ i-V _> x[ q{s+l)) ,s > 0. (4.1) 

Hence each vector x^ has at least one coordinate equal to — oo for any m > 1. If 
= Uj for some j then the cycle ()4.ip gives the (/-cycle u\ — > U2 — > • • • — > u q — > u\ . □ 

Case (i): Using notations of the previous section we get that x^ = for any j = no + 
1, . . . , n and m > 1. Moreover x^ € X„ jno , m > 1. Thus the investigation of trajectory 
x^ m \m > can be reduced to investigation of trajectory u^ m+1 ^ = B(u^ m ^), m > with 
operator B : J no — > J no where 

J n = {x G R" ax : Xi < 0,V? = 1, . . . ,n}, 

and B = (a«)ij=i ... no is the no x no-minor of matrix A. 
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It is known (see, for example, [5]) that the eigenvalues and eigenvectors of B deter- 
mine the behavior of trajectories. For example, if u is an eigenvector of B, with a real 
eigenvalue smaller than one, then the straight lines given by the points along au, with 
a G R, is an invariant curve of the map B. Points in this straight line run into the fixed 
point. 

The following theorem is a corollary of a known Theorem of the theory of linear 
dynamical systems [5]. 

Theorem 4.2. Suppose B : J nQ — > J no has eigenvalues Ai, . . . , A no 

1. J/|Ai| < I, i = l,...,n then u(x^) = {(0, . . . ,0)} for any x^ GZ n . 

2. If |Aj| > 1, i = 1, . . . , no then lim m ^. +00 x^~ m ^ = (0, . . . , 0) for any x^ G l n . 

3. If\Xi\<l,i = l,...,p and |A»| > 1, i = p+1, ■ ■ ■ , no then there is ap dimensional 
space W s C K max and a no — p dimensional space W u C TL max on which 

3.a) // eW s nl n , then u{x^) = {(0, . . . ,0)}. 

3.b) // sc(°) G W u fl X n , then lim m ^ +00 x^ = (0, . . . , 0) . 

3.c) Ifxeln\ (W s U W u ) then lim m _> +00 \x^ \ = +oo. 

Let us now consider an example: 

Example 2. Consider A = ( a ^ a * 2 ^ . In this case we have A n = ( a n^ ai2 

Consequently, for any x^ = (x^\x^) G I2 we obtain 

= A n (x^) = {a^xf + a^a^xf^) 

and 

( (0,0), if an < 1, 

lim iW = lim (a n xi 0) + a^fWf, 0) = { (xf } + a 12 xf ,0), if a n = 1, 

^ (—00, 0), if an > 1. 

Case (ii): In this subsection we shall study trajectory x^ , m > for a linear operator 
A which satisfies condition (ii) of Theorem 12.11 

Suppose the operator A = A w corresponds to the permutation it which has the fol- 
lowing decomposition into disjoint cycles 

VT = (jll,il2, ■■;hki){i21,i22, i2k 2 )---(iqi, iq 2 : hk q ): 1 < q < n, 1 < kj < n. 

By Proposition 12.21 we have A™ = A n m, where 7r m = Tt m ~ l Tt is m-th iteration of 7r. 

Denote Q p = a iplip2 a ip2ipi . . . a ip(kp _ 1)ipkp a ipkp i pl , p = l,...,q. The following theorem 
gives complete description of the trajectory: 

Theorem 4.3. // i G {i p i, i P 2, i p k p } for some p = 1, ... ,q then 



,. (kpS+r) 

nm x - 



{ 0, if Q p < 1; 

ITjZl <V(*>H-i(i)) a$? w> if Q P = l,0<r< k p ; (4.2) 
-00, if Q p > 1, 



10 U.A. ROZIKOV, M.M. KARIMOV 

Proof. From = A n (x^ Tn ~ 1 " ) ) we get 

m— 1 

M _ (m-l) _ (m-2) _ _ TT (0) o\ 

i=o 

For i G {i p i,i p 2, ■■■,ipk p } and m = fe p s + r from (|4.3p we get 

r-1 

(kps+r) _ n sTT (0) ,n 

i=o 

This equality completes the proof. □ 

Remark 4.4. By Theorem \3.4\ we know that in case Q p = 1 there are infinitely many 
fixed points. The equality ( f^.£| ) shows that in this case the limit of the ith coordinate does 
not exist, it depends on the remainder r. 

Example 3. Consider A = \ ^ a i 2 ) . It is easy to get 

V «2l U / 



A 2s = 
Consequently, 



^ A ) and A^=f ° 1 ^V^O. 



({ai 2 a 2 i) s xf\ (a 12 a 21 ) s x 2 0) ), if m = 2s, 
({ai 2 a 2 i) s ai 2 x^ 2 \ (ai 2 a 2 i) s a 2 ixf^) if m = 2s + 1. 



Hence 



lim x^ 8 ^ 



(0,0), if a 12 a 21 < 1, 
(xf^X^), if 012022 = l)f = 0, 
(ai 2 x^ 0) ,a 2 ixf ) ), if ai 2 a 2 2 = l,r = 1, 
(— oo, 0) or (0, — oo), if a\ 2 a 2 \ > 1. 
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